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Abstract 

This  thesis  describes  new  algorithms  to  localize  regions-of-interests  (ROIs)  three  di¬ 
mensionally  from  a  pair  of  digitized  mammograms.  This  work  is  intended  to  add  a  layer 
of  sophistication  to  computer  aided  diagnosis  by  putting  to  use  the  fixed  and  measurable 
parameters  of  mammographic  imaging.  The  fixed  parameters  are  the  source  to  film  orienta¬ 
tion  and  the  podium-image  distance.  Measurable  parameters  are  the  rotation  angle  of  the 
x-ray  tube  from  the  horizontal  and  the  compression  depth  (the  distance  from  compression 
paddle  to  contact  podium  distance)  at  the  time  of  imaging. 

As  an  additional  benefit,  three  dimensional  localization  algorithms  alleviate  the  con¬ 
fusion  radiologists  may  have  in  determining  the  particular  quadrant  of  a  breast  lesion 
identified  for  further  examinations  or  biopsies. 

This  feasibility  investigation  located  microcalcifications  within  10-15  mm  and  elim¬ 
inates  quadrant  ambiguities.  Accuracy  measures  are  based  on  knowing  the  fixed  param¬ 
eters,  source-image  distance  and  podium-image  distance,  of  the  mammography  imaging 
system  with  accuracies  of  ±5  mm  and  ±2  mm  respectively  and  the  adjustable  parameters, 
x-ray  tube  rotation  angle  and  the  compression  depth  with  accuracies  of  ±5°  and  ±10  mm 
respectively. 
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Three  Dimensional  Localization  of  Lesions 


from  Digitized  Mammograms 


I.  Introduction 

Cancer  of  the  breast  is  one  of  the  major  health  problems  of  women:  it  is  our  most 
common  malignancy  and  second  most  deadly  after  lung  cancer.  The  5-year  relative  sur¬ 
vival  figures  for  breast  cancer  found  in  pre-invasive,  invasive,  or  metastatic  stages  are, 
respectively,  92  percent,  71  percent,  and  18  percent.  [1]  These  statistics  compiled  by  the 
National  Cancer  Institute  imply  that  breast  cancer  in  the  metastatic  stage  -  cancer  that 
has  spread  to  other  parts  of  the  body  -  is  a  much  more  serious  disease...  where,  for  many, 
detection  and  treatment  have  come  too  late.  Therefore,  the  detection,  prevention  and 
control  of  breast  cancer  in  its  early  stages  are  foremost  in  the  minds  of  patients,  medical 
personnel  and  researchers. 

Mammography  has  proven  the  most  valuable  tool  in  breast  cancer  screening  due  to 
the  radiologists’  ability  to  detect  early  cancers  with  a  high  degree  of  sensitivity  and  a 
reasonable  degree  of  specificity.  In  a  14-year  study,  the  Breast  Cancer  Detection  Demon¬ 
stration  Projects  demonstrated  the  extent  of  mammography’s  utility.  [2,  3]  Of  the  cancers 
categorized  as  minimal  (lesions  less  than  1  cm  in  diameter  or  pre-invasive),  only  6  percent 
were  detected  during  a  physical  examination  by  a  professional  using  palpation.  The  re¬ 
maining  minimal  cancers  were  either  identified  by  mammography  alone  (57  percent)  or  by 
both  mammography  and  physical  examination  (37  percent).  With  modern  mammography 
equipment,  the  risk  of  radiation-induced  cancers  is  so  minute  that  annual  mammography 
examinations  are  universally  recommended  to  women  ages  50  and  above.  Additional  data 
suggests  that  women  ages  40  to  49  would  also  benefit  from  the  same  annual  examina¬ 
tion  [4,  3];  but,  at  present,  prohibitive  cost  and  the  limited  number  of  trained  radiologists 
precludes  the  expanded  use  of  mammography.  [5,  6] 

The  process  of  reviewing  mammograms  may  be  made  more  efficient  with  the  inclusion 
of  an  automated  detection  system.  The  radiologist  would  remain  the  primary  reviewer 
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Figure  1.1  Illustration  of  typical  mammography  review.  The  center  four  images  are  from 
the  patient’s  most  resent  screening;  outside  images  represent  the  set  from  the 
patient’s  previous  mammography  examination.  The  four  images  on  the  right 
depict  the  patient’s  left  breast;  the  left  images  correspond  to  the  right  breast. 
This  arrangement  matches  the  orientation  of  the  patient  facing  the  reviewer. 

but  delegate  quality  control  responsibilities  to  a  Computer  Aided  breast  cancer  Diagnosis 
(CADx)  system  which  would  provide  a  “second  opinion”  in  diagnosis.  [7] 

To  provide  acceptable  quality  control,  a  CADx  system  must  be  on  par  with  the  ra¬ 
diologist  —  taking  advantage  of  all  the  information  the  radiologist  has  available  from  the 
full  mammography  examination.  The  annual  mammography  examination  is  done  in  three 
parts:  an  interview  of  the  patient  where  a  history  relative  to  breast  disease  is  taken,  a  phys¬ 
ical  examination  of  the  breasts  in  search  of  palpable  lesions,  and  the  actual  mammography 
screening.  The  standard  mammography  screening  consists  of  four  images:  that  is,  two 
images  of  each  breast  taken  at  different  aspects,  or  views.  Upon  review  by  a  radiologist, 
the  films  are  arranged  so  that  the  corresponding  view's  of  the  right  and  left  breast  appear 
as  mirror  images.  This  arrangement  is  illustrated  in  Fig.  1.1  which  includes  the  placement 
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of  films  from  the  patient’s  last  screening.  The  films  are  arranged  to  facilitate  (1)  the  detec¬ 
tion  of  asymmetries  between  the  contralateral,  or  “mirrored”,  views,  (2)  three  dimensional 
localization  of  asymmetries  in  the  complementing  views  of  the  same  breast,  and  (3)  the 
evaluation  of  changes  since  the  last  screening.  In  addition  to  these  cues,  the  radiologist 
may  be  prompted  by  a  physician  or  by  the  patient  themselves  to  concentrate  attention  in 
a  specific  region  where  a  palpable  lesion  was  detected  or  some  other  symptom  that  may 
point  to  malignancy.  A  clinically  viable  CADx  system  must  be  tuned  to  detect  subtleties 
on  the  order  of  those  apparent  to  a  radiologist  without  generating  false  detections,  or  “false 
positives”,  that  would  unnecessarily  distress  the  patient  and  care-givers. [5] 

Predominately,  the  work  in  CADx  systems  [8,  9,  10,  11,  12,  13,  14]  has  concentrated 
on  single-image  strategies  to  recognize  abnormalities  in  texture  and  other  visual  patterns. 
Additionally,  several  researchers  [7,  15,  16,  17]  have  compared  contralateral  breast  views  - 
as  the  radiologist  does  -  to  detect  asymmetries.  The  basic  alignment  techniques  of  these 
works  follow: 

•  Yin,  et  al,  align  the  mammography  films  of  the  right  and  left  breast  by  hand  prior 
to  digitization.  [7] 

•  Hand,  et  al,  translate  the  contralateral  breast  views  up  and  down,  left  and  right  to 
achieve  the  “best”  fit.  [16] 

•  Kimme,  et  al,  account  for  variations  in  the  size  and  shapes  of  the  contralateral  breast 
when  they  divide  the  breast  into  sections  that  will  feed  their  segmentation  module. 
[17] 

•  After  translating  and  rotating  the  breast  to  align  edge  features,  Lau,  et  al ,  remap 
all  the  pixels  of  the  left  breast  area  to  the  right  breast  area  based  on  the  width  and 
height  ratios  of  the  breast  boundaries.  [15] 

All  of  the  above  works  relied  on  the  assumption  that  the  aspect  angles  are  the  same  for 
the  contralateral  views. 

No  substantial  work  has  been  published  on  region-of-interest  (ROI)  verification  through 
three  dimensional  localization  of  asymmetries  or  abnormalities.  In  1979,  Spiesberger 
sketched  out  a  strategy  for  verifying  the  detection  of  a  small  lesion  by  comparing  the 
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craniocaudal  (CC)  and  lateral  medial  (LM)  views  of  a  breast.  [18]  Spiesberger  presented 
no  physical  basis  for  his  algorithm,  and  he  did  not  go  into  any  great  detail  about  its  imple¬ 
mentation  since  it  required  the  processing  of  entire  mammograms  which  at  the  time  was 
infeasible. 

Three  dimensional  localization  of  lesions  from  mammograms  is  extremely  difficult 
problem  due  to  the  many  variances  in  mammography  imaging...  particularly  those  im¬ 
posed  by  the  use  of  breast  compression.  Nevertheless,  the  implementation  of  standardized 
practices  in  mammography  has  put  three  dimensional  localization  within  reach. 

The  advances  that  have  made  this  work  possible  are: 

•  The  use  of  dedicated  mammography  equipment. 

•  The  standardization  of  radiographic  views  and  patient  positioning  procedures. 

•  The  availability  of  computational  resources  that  can  handle  high  resolution  images 

of  entire  mammograms. 

1.1  Statement  of  the  Problem 

In  the  development  of  Computer  Aided  breast  cancer  Diagnosis  (CADx)  systems 
modeled  after  the  radiologists’  mammography  review,  the  next  logical  step  is  to  implement 
a  three  dimensional  localization  strategy  that  verifies  the  detection  of  malignant  lesions 
from  complementing  mammography  views.  This  thesis  develops  a  compression  recovery 
model  and  back-projection  algorithms  that  achieve  that  end. 

1.2  Scope 

The  3D  localization  algorithms  herein  are  developed  specifically  for  standard  mam¬ 
mography  screenings  where  craniocaudal  (CC)  and  medial  lateral  oblique  (MLO)  radio- 
graphic  views  are  performed  and  where  the  mammography  unit  is  equipped  with  a  90° 
compression  paddle. 

To  support  this  work,  mammogram  films  were  obtained  from  the  Wright-Patterson 
Air  Force  Base  (WPAFB)  Hospital.  The  films  were  digitized  to  12  bits  of  grayscale  at 
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a  resolution  of  100/xm.  The  digitized  images  were  cropped  to  2048  x  1024  pixels.  The 
locations  of  film  edges  were  preserved  in  a  database. 

The  algorithms  proposed  are  part  of  a  CADx  system  that  serves  to  re-cue  the  ra¬ 
diologist  to  potentially  malignant  areas  in  a  set  of  mammograms.  The  algorithms  were 
written  in  the  Matlab  software  environment  and  augmented  by  C  routines  tailored  to  the 
application. 

1.3  Overview 

Chapter  II  presents  the  key  advances  in  mammography  imaging  and  the  standard¬ 
ized  patient-positioning  procedures.  Chapter  III  examines  the  effects  of  compression  on 
the  breast  and  develops  the  compression  recovery  models  crucial  to  this  work.  Chapter  IV 
incorporates  the  compression  recovery  models  into  the  geometry  imposed  by  the  mammog¬ 
raphy  imaging  system.  Chapter  V  charts  the  entire  3D  localization  algorithm  and  presents 
prelimary  results.  Chapter  VI  discusses  the  conclusions  regarding  the  usefulness  of  this 
work. 
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II.  Background 


In  the  past  two  decades,  the  arrival  of  dedicated  diagnostic  tools  and  new  medical 
procedures  has  led  to  an  increase  in  detection  of  precancerous  and  non-invasive  breast 
lesions.  This  chapter  presents  the  state  of  the  art  in  mammography  and  a  more  detailed 
discussion  of  its  current  practice.  The  material  will  underline  the  advancements  that  have 
made  this  work  both  possible  and  necessary. 

2.1  State  of  the  Art  in  Mammography 

2.1.1  Advances  in  Equipment.  High  quality  mammography  employs  dedicated 
machines  known  as  film/screen  x-ray  units.  An  innovation  developed  in  the  early  1970’s  and 
in  widespread  use  by  the  early  1980’s,  film/screen  x-ray  units  employ  lower  radiation  levels 
and  shorter  exposure  times  than  the  industrial  non- film/screen  x-ray  units  traditionally 
used  for  bone  and  chest  x-rays.  Film/screen  x-ray  units  were  designed  to  make  annual 
mammography  plausible  by  lowering  the  patient’s  exposure  to  radiation.  Immediately, 
however,  added  benefits  were  realized.  Though  image  resolution  of  film/screen  is  inherently 
less  than  that  of  industrial  non-screen  film,  the  lower  radiation  levels  result  in  improved 
contrast,  and  the  shorter  exposure  time  reduces  blurring  due  to  movement  -  a  significant 
problem  in  mammography  since  the  breast  is  near  the  heart.  Film/screen  mammography 
has  outdistanced  industrial  film  in  terms  of  overall  image  quality  with  new  film  technology, 
and  additional  innovations  which  include  a  fixed  source  to  film  orientation  with  longer 
source-to-image  distance,  smaller  focal  spots,  and  the  use  of  breast  compression.  [5] 

2.1.2  Motivations  for  Breast  Compression.  Vigorous  compression  is  mandatory 
for  acceptable  image  quality  as  it  promotes:  [5,  19] 

•  Improved  resolution. 

•  Improved  geometric  sharpness  by  reducing  the  object  to  image  receptor  distance. 

•  Improved  image  contrast  by  decreasing  breast  thickness  thus  reducing  radiation  scat¬ 
tering. 
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Figure  2.1  Effects  of  breast  compression  on  image  quality.  The  sharper  mammogram  on 
the  left  is  the  CC  view  of  a  compressed  breast.  The  mammogram  on  the  right 
was  taken  of  the  same  breast,  from  the  same  aspect,  but  without  compression 
[19] 

•  Minimization  of  image  blurring  due  to  motion  by  preventing  patient  movement  during 
exposure. 

•  Separation  of  breast  structures  which  lessens  the  likelihood  of  the  obscuration  of  a 
lesion. 

•  Uniform  exposure  of  posterior  and  anterior  parts  of  the  breast  by  conforming  breast 
to  a  uniform  thickness. 

Two  mammograms  are  presented  in  Fig.  2.1  which  depict  the  same  breast  compressed 
and  uncompressed  respectively.  The  image  of  the  compressed  breast  is  better  for  depicting 
tissue  throughout  the  entire  breast.  The  image  of  the  uncompressed  breast  was  used  to 
view  a  lesion  near  the  chest  wall  (marked  by  dark  arrow)  but  has  poor  contrast  in  the 
anterior  part  of  breast.  The  uncompressed  breast  image  is  blurred  significantly  by  motion, 
and  the  breast  boundary  -  the  transition  from  breast  tissue  to  background  -  is  more  subtle. 

2.1.3  Rotating  X-ray  Tube.  Another  key  innovation  in  modern  mammography 
equipment  has  made  the  orientation  of  the  patient  to  the  x-ray  tube  easier.  In  an  annual 
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Figure  2.2  Dedicated  mammograhy  unit  with  rotating  anode  x-ray  tube. 


mammography  screening,  the  patient  stands  and  the  x-ray  tube  rotates.  Figure  2.2  provides 
a  drawing  of  a  mammography  system  with  rotating  anode  x-ray  tube.  The  versatility  of 
this  setup  alleviates  the  need  to  move  the  patient  into  awkward  positions  and  has  allowed 
the  standard  use  of  viewing  positions  refined  to  the  anatomy  and  mobility  of  the  breast. 
These  refined  views  and  their  advantages  are  discussed  further  in  Section  2.2.  [19,  20] 

2.1.4  Summary.  Of  the  innovations  in  modern  mammography  units,  the  fixed 
source-to-film  position  and  small  spot  size  facilitate  3D  localization.  Unfortunately,  breast 
compression  complicates  the  undertaking  by  scaling  the  dimensions  in  alternate  views 
disproportionately. 

Since  vigorous  compression  is  used  to  procure  high  quality  mammograms,  a  com¬ 
pression  recovery  model  must  be  developed. 

2.2  Standard  Views 

The  versatility  of  the  rotating  x-ray  tube  has  led  to  the  refinement  of  standard  viewing 
positions  which  adapt  to  the  anatomy  and  natural  mobility  of  the  breast.  As  a  consequence, 
many  medical  facilities  perform  the  medial  lateral  oblique  and  the  craniocaudal  views  in 
all  annual  mammography  screenings.  Figure  2.3  illustrates  anatomical  references  for  the 
radiographic  views:  [19,  20] 

These  standardized  views  and  their  well-documented  patient-positioning  procedures 
work  with  the  natural  shape  of  the  breast  —  minimizing  potential  distortions  and  maximiz¬ 
ing  the  predictability  of  key  “landmark”  locations.  These  landmarks  -  which  include  the 
nipple  line  and  the  pectoral  muscle  wall  -  are  required  to  enable  proper  alignment  of  the 
image  view  to  its  counterpart.  [19,  21,  20] 

2.2.1  Optimal  Positioning.  The  optimal  radiographic  view  depicts  as  much 
breast  tissue  as  possible.  Accordingly,  as  compression  is  applied  normally  to  the  image 
plane,  care  must  be  taken  to  avoid  moving  the  compression  paddle  against  the  fixed  tissues 
of  the  breast.  The  fixed  aspects  of  the  breast  are  the  medial  and  superior  margins;  the 
mobile  aspects  are  the  lateral  and  the  inferior  margins.  In  an  optimal  view,  the  radiologic 
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Figure  2.3  Anatomical  references  for  radiographic  views.  [5] 


technologist  lifts  the  mobile  tissue  of  the  patient’s  breast  away  from  the  chest  wall  and 
towards  the  fixed  tissue.  [19,  20] 


2.2.2  Medial  Lateral  Oblique  View.  The  medial  lateral  oblique  (MLO)  view  offers 
the  best  opportunity  to  image  all  of  the  breast  tissue  in  a  single  mammogram,  particularly 
the  superolateral  portion  of  the  breast  where  most  breast  cancers  are  found.  As  shown  in 
Fig.  2.4,  the  x-ray  beam  is  directed  from  the  superomedial  to  the  inferolateral  aspect  of 
the  breast.  The  image  receptor  is  placed  parallel  to  the  patient’s  pectoral  muscle,  so  that 
the  image  plane  is  at  an  angle  of  30°  to  60°  from  the  horizontal.  In  an  ideal  MLO  view  as 
in  Fig.  2.6,  the  pectoral  muscle  is  visible,  inframammary  fold  is  open,  and  the  nipple  is  in 
profile.  Typically,  the  nipple  line  of  the  MLO  view  appears  at  an  angle  to  the  film  axes. 
[19] 


2.2.3  Craniocaudal  View.  The  craniocaudal  (CC)  view  augments  the  MLO  view 
and  captures  the  medial  tissue  that  the  latter  view  might  have  missed.  As  depicted  in 
Fig.  2. 5, the  x-ray  beam  is  directed  from  the  superior  portion  of  the  breast  to  the  inferior, 
or  from  “head-to-tail”  as  its  name  implies.  The  image  receptor,  and  thus  image  plane, 
is  parallel  to  the  horizontal.  Figure  2.6  contains  a  CC  view  mammogram.  The  pectoral 
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Figure  2.4 


Figure  2.5 


MLO  view  by  anatomical  references:  Positioning  for  the  medial  lateral  oblique 
view  of  the  left  breast. 


CC  view  by  anatomical  references:  Position  for  the  craniocaudal  view  of  the 
left  breast. 
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muscle  is  visible  in  only  20  %  of  all  CC  views.  Ideally,  the  nipple  is  centered,  and  the 
nipple  line  of  the  CC  view  is  nearly  aligned  with  the  film  axes.  [19] 

2.2.4  MLO  and  CC  as  Complementary  Views.  The  nipple  line  is  a  projection  of 
the  shared  axis  of  the  MLO  and  CC  view.  If  the  angular  difference  of  x-ray  tube  between 
the  views  is  known  and  the  angular  difference  of  the  nipple  line  on  the  films  is  determined, 
the  only  imaging  parameters  that  stand  in  the  way  of  triangulation  is  the  degree  of  object 
distortion  imposed  by  breast  compression. 

Due  to  compression,  the  breast’s  dimensions  are  seen  disproportionately  by  each 
view  as  illustrated  in  Fig.  2.7.  If  one  attempted  to  back-project  from  a  point-of-interest 
to  its  respective  source,  the  resulting  lines-of-sight  for  the  MLO  and  CC  views  would 
not  intersect  meaningfully  except  where  the  object-of- interest  lies  along  the  rotation  axis. 
(The  rotation  axis  is  coming  out  of  the  page  and  depicted  at  the  nipple  in  Fig.  2.7.)  If 
the  compressed  breast  can  be  rescaled  properly  as  in  Fig.  2.8,  it  becomes  possible  to  back- 
project  from  corresponding  points-of-interest  to  their  respective  sources  and  to  localize  an 
object-of-interest  in  three  dimensional  space  at  the  intersection  of  the  scaled  lines-of-sight. 

2.2.5  Summary.  The  use  of  dedicated  mammography  units  and  the  standard¬ 
ization  of  patient  positioning  have  made  the  products  of  mammography  more  predictable. 
However,  the  effects  of  breast  compression  must  be  understood  and  reversed  for  3D  local¬ 
ization  schemes  to  work. 

The  next  chapter  presents  a  compression  model  applicable  to  mammography  and 
develops  expressions  for  compression  recovery  parameters. 
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Medial  Lateral  Oblique  Craniocaudal 

ure  2.6  Standard  mammograms  of  a  right  breast.  Note,  in  both  views,  the  nipple  is 
in  profile  and  is  marked  by  a  2 mm  lead  BB.  For  the  MLO  view,  the  pectoral 
muscle  wall  clearly  visible  in  the  upper  right-hand  corner,  and  in  the  lower 
right-hand  corner,  the  inframammary  fold  is  open. 
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Figure  2.7  Disproportionate  aspects  of  a  left  breast  for  the  CC  and  MLO  views  due  to 
breast  compression. 

CC  source 
location 
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Figure  2.8  Desired  aspects  of  left  breast  for  CC  and  MLO  Views. 
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III.  Compression  Model 


The  goal  of  compression  recovery  is  to  reconform  the  breast  to  a  basic  shape  which  the 
computer,  the  radiologist  and  the  physician  can  readily  interpret.  This  chapter  will  present 
a  model  for  the  breast’s  shape,  the  conclusions  from  an  empirical  study  of  compression 
effects  on  similar  objects,  and  the  development  of  expressions  for  compression  recovery 
parameters. 

3.1  The  Uncompressed  Breast  as  an  Ellipsoid  of  Revolution 

The  shape  of  the  uncompressed  breast  can  be  modeled  as  a  half  ellipsoid  of  revolution. 
This  is  the  generic  shape  to  which  a  breast  would  conform  if  its  tissue  could  support  its 
own  weight. 

3.1.1  Terminology.  An  ellipsoid  of  revolution,  as  seen  in  Fig.  3.1,  is  defined  as 
the  ellipsoid  generated  by  revolving  an  ellipse  about  one  of  its  axes.  Sections  in  planes 
perpendicular  to  the  fixed  axis  are  all  circles.  [22] 

The  fixed  axis  is  designated  the  axis  of  revolution.  In  mammography,  patient  posi¬ 
tioning  ensures  that  the  axis  of  revolution  is  parallel  to  the  image  plane.  This  axis  is  a  key 
reference:  it  is  about  the  axis  of  revolution  that  the  object  is  compressed,  decompressed 
and  rotated  between  MLO  and  CC  views.  As  an  added  convention,  the  “aspect  plane” 
will  refer  to  the  plane  that  contains  the  axis  of  revolution  and  runs  parallel  to  the  image 
plane.  The  intersection  of  the  MLO  aspect  plane  and  the  CC  aspect  plane  is  the  axis  of 
revolution.  The  pole  of  the  half-ellipsoid  is  the  intersection  of  the  half-ellipsoid  and  the 
axis  of  revolution.  [22] 

The  semiaxes  of  the  half-ellipsoid  are  established  as  a,  b  and  c:  where  a  =  c  ^  b  as 
seen  in  Fig.  3.1.  [22] 

3.1.2  Volume.  The  volume  of  a  half-ellipsoid  is:  Volume  -  jnabc.  When 
compression  is  applied  to  the  breast,  we  will  assume  that  volume  is  preserved.  If  the 
half-ellipsoid  experiences  uniform  compression  normal  to  the  axis  of  revolution,  then  [22]: 
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Volume  =  -7r  abc  =  -iva'b'c 
o  o 


where  the  c  semiaxis  is  compressed  by  a  factor  C  so  that: 


c'  -  c/C  (3.2) 

afbl  =  Cab  (3.3) 

If  the  breast’s  physical  structure  allowed  it  to  expand  equally  in  all  directions  normal 
to  the  force  of  compression,  then  a '  =  yfCa  and  V  =  yfCb .  However,  in  studying  fibrous 
objects,  it  becomes  obvious  that  the  physical  nature  of  breast  tissue  prominently  favors 
expansion  in  one  direction.  The  next  section  will  detail  the  observations  made  in  applying 
vigorous  compression  to  breast-like  objects. 

3.2  Study  of  Compressed  Objects 

Breast  compression  is  accomplished  by  pressing  the  tissue  between  a  90°  compression 
paddle  and  a  contact  podium  which  contains  the  x-ray  film.  This  arrangement  is  depicted 
in  Fig.  3.5.  Under  vigorous  compression,  the  breast  experiences  25  to  35  pounds  of  force. 

The  degree  of  compression  is  determined  by  the  pliancy  of  the  tissue  and  the  amount  of 

discomfort  the  patient  can  tolerate  during  the  screening  procedure.  According  to  quality 
control  guidelines,  vigorous  compression  must  be  applied  so  that,  at  a  minimum,  the  breast 
tissue  is  taut  and  gentle  tapping  does  not  indent  the  skin.  At  maximum,  the  compression 
should  be  less  than  painful  [19,  23] 

3.2.1  Object  Selection  Criteria.  To  understand  the  effects  of  compression, 
natural-occurring  objects  have  been  studied  under  vigorous  compression.  The  chosen  ob¬ 
jects  are  composed  of  soft,  fibrous  tissue  surrounded  by  a  layer  of  skin.  Their  shapes  - 
though  variable  -  suggest  ellipsoids  whose  semiaxes  a,  b  and  c  meet  the  criteria  a  &  c  <  b 
where  the  major  semiaxis,  6,  runs  along  the  grain  of  the  fibrous  tissue.  The  objects’  criteria 
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Figure  3.1  Half-ellipsoid  of  revolution  (a  =  c  7^  b).  Axis  of  revolution  is  along  y  axis 

match  the  physical  nature  of  the  breast.  The  “grain”  of  the  breast  is  provided  by  the  net¬ 
work  of  ducts  and  fibrous  connective  tissue  that  extend  from  the  nipple  and  to  mammary 
lobules.  In  other  words,  the  grain  of  the  breast  and  the  axis  of  revolution  run  parallel  to 
the  nipple  line. 

3.2.2  Notation.  To  clarify  a  test  object’s  orientation,  reference  axes  are  assigned 
as  follows: 

•  The  y  axis  is  the  axis  of  revolution. 

•  The  z  axis  is  parallel  to  the  force  of  compression  and  thus  normal  to  the  image  plane. 

•  The  x  axis  is  perpendicular  to  y  and  z. 

Note  that  that  the  orientation  of  the  x  and  z  axes  is  dependent  on  the  viewing  aspect  of 
the  breast.  The  y  axis  is  the  only  reference  axis  common  to  the  MLO  and  CC  views. 

3.2.3  Compression  Effects. 

3.2.3. 1  Unequal  Deformation  of  Axes.  When  vigorous  compression  is  ap¬ 
plied  along  the  z  axis  of  a  test  object,  the  object  expands  along  x,  or  along  the  dimension 
perpendicular  the  object’s  grain.  In  each  case,  the  object  changed  only  subtly  along  its 
y  axis.  This  reaction  is  due  to  the  fibrous  nature  of  the  tissue  which  resists  expansion 
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along  the  grain.  The  compressed  object  -  which  adapts  to  conserve  volume  -  adjusts  in 
the  dimension  in  which  it  is  most  free  to  move. 

If  uniform  compression  is  applied  to  the  ellipsoid  as  described  in  Section  3.1.1,  the 
objects  reacts  according  to  Eqs.  3.1  through  3.3.  Prom  the  physical  nature  of  fibrous  tissue, 
its  dimensions  along  the  y  axis  will  remain  unchanged,  and  so: 

Given  the  geometric  conditions, 


Volume 

a 


and  given  the  compression  conditions, 


c'  =  c/C 
b'  -  b 

it  follows: 


a  =  C  *  a 

a  =  C2-c'  (3.4) 


Therefore,  if  c'  and  a’  are  known  the  compression  factor  can  be  calculated: 


and  the  original  object’s  dimensions  recovered: 
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Figure  3.2  Comparison  of  two  imaging  systems  with  different  object-source  ratios.  Note 
that  the  imaging  system  with  the  larger  source-image  distance  projects  its 
shadow  from  a  plane  closer  to  its  aspect  plane  (solid  axis)  than  the  imaging 
system  with  a  smaller  source-image  distance. 


(3.6) 

(3.7) 

(3.8) 

3. 2. 3. 2  Location  of  Aspect  Plane.  Soft  tissue  under  vigorous  compression 
will  distribute  its  volume  symmetrically  between  the  compression  paddle  and  podium  so 
that  the  thickest  cross  section  of  the  object  lies  in  a  plane  half  way  between  the  paddle  and 
podium.  This  plane  is  denoted  as  the  aspect  plane.  If  the  object  is  illuminated  by  a  far 


c=C-d 


a  =  \/a'c  —  c 
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Figure  3.3  Utilization  of  compression  to  effectively  reduce  object-source  ratio.  The  com¬ 
pressed  object  projects  its  shadow  closer  to  its  aspect  plane  (solid  axis)  than 
the  uncompressed  object. 

field  source,  the  object  will  cast  a  shadow  defined  by  its  cross  section  in  the  aspect  plane. 
A  far  field  source  has  a  low  object-source  ratio  -  a  ratio  given  by  the  object  distance  to 
the  image  plane  over  the  source  distance  to  the  image  plane.  The  shadows  cast  by  imaging 
systems  of  different  object-source  ratios  are  illustrated  in  Fig.  3.2. 

Object  compression  lowers  the  object-source  ratio  of  the  imaging  system  (see  Fig.  3.3), 
giving  the  advantages  of  a  far  field  source  without  the  disadvantages.  Specifically,  the  ge¬ 
ometric  sharpness  of  the  image  improves  without  excessive  attenuation  of  the  x-ray  field 
since  the  field  travels  through  a  thinner  layer  of  absorbing/scattering  tissue. 

3. 2. 3. 3  Point  of  Common  Reference  on  Axis  of  Revolution.  A  common 
reference  point  must  be  found  to  align  the  aspect  planes  of  the  MLO  and  CC  views. 
Recall  that  the  ellipsoidal  object  experiences  no  expansion  or  contraction  along  its  y  axis 
regardless  of  compression  applied  or  the  rotation  of  z  about  y.  Again,  if  the  compressed 
object  is  illuminated  by  a  far  field  source  as  in  Fig.  3.4,  the  maximum  extent  of  its  shadow 
in  the  y  direction  will  be  projected  from  a  predictable  physical  point.  This  predictable 
physical  point  corresponds  to  the  pole  of  the  half-ellipsoid. 

On  both  the  MLO  or  CC  mammogram,  the  pole  of  the  ellipsoidal  breast  is  projected 
to  an  image  point  denoted  ymax  as  it  is  the  maximum  extent  of  the  breast  boundary  in  y 
direction.  The  location  of  the  pole  will  be  established  as  the  origin  of  the  reference  axes 
in  both  the  MLO  and  CC  view. 
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Figure  3.4  Maximum  extent  of  nipple  line  corresponds  to  pole  of  the  half-ellipsoid.  The 
nipple  line  is  the  projection  of  axis  of  revolution  onto  the  image  plane. 

3.3  Development  of  Compression  Recovery  Parameters 

3.3.1  Uniform  Compression.  A  general  recovery  scheme  can  be  developed  using 
Eqs  3. 5-3. 7  and  applied  to  any  point  Oc  =  [xc,yc,zc]T  within  the  compressed  ellipsoid. 
Assuming  the  origin  [0,0, 0]T  is  at  the  center  of  the  original  ellipsoid,  the  point  O  = 
[x0,yo,z0]T  corresponds  to  Oc  where: 


Vo  =  Vc 

z0  =  C  ■  zc 


The  above  calculations  can  be  done  using  one  simple  matrix  transformation: 

0  =  SOc  (3.9) 
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ComDression  Daddle 


y  =  y©iiPs  v=o 


Figure  3.5  Notational  references  for  breast  ellipsoid.  The  x  axis  is  out  of  the  page, 
where  S  is  expressed  by  compression  recovery  parameters,  7X  and  jz: 


7,  =  (3.10) 

7*  =  yft  (3.11) 


S  = 


7*  0  0 

0  1  0 


o  o  7z 


(3.12) 


Since  S  is  a  diagonal  matrix,  its  inverse  is  easily  determined  and  can  be  used  to 
model  the  compression  of  an  object  point: 


Oc  =  S-1  0  (3.13) 

3.3.2  Compression  to  a  Uniform  Thickness.  If  the  compression  paddle  exerted 
a  uniform  compression  on  the  breast  ellipsoid,  the  compression  recovery  parameters  could 
be  found  by  Eqs.  3.10  and  3.11.  However,  reality  is  more  complicated.  The  90°  compres¬ 
sion  paddle  does  not  exert  uniform  compression,  but  compresses  the  anterior  to  posterior 
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parts  of  the  breast  to  a  uniform  thickness.  The  resulting  deformed  shape  of  the  breast 
is  a  flattened  ellipsoid.  The  tip  of  the  breast  has  an  elliptical  cross  section  in  the  x-z 
plane  and,  thus,  experiences  uniform  compression.  However,  in  the  posterior  region  of  the 
breast  beginning  at  a  certain  distance  yeups  from  the  pole,  the  skin  collapses  against  the 
compression  plate,  and  the  x-z  cross  section  takes  the  generic  form  of  Fig.  3.6.  The  cross 
section  can  be  approximated  by  a  box  flanked  by  two  half  ellipses. 

The  anterior  tip  of  the  compressed  breast  ellipsoid  experiences  uniform  compression. 
Only  one  calculation  is  necessary  to  compute  yx  and  T-  in  this  region.  The  posterior  region 
of  the  breast  experiences  compression  to  a  uniform  depth.  The  compression  recovery 
parameters  are  not  constant  in  this  region  and  do  not  have  a  reciprocal  relationship. 
Equations  3.10-3.12  are  generalized  to: 


7 *(»)  = 

7.(y)  = 


(3.14) 

(3.15) 


s  (y)  = 


7 x(y)  o  o 
0  1  0 
0  0  7 z{y) 


(3.16) 


where 

•  The  uncompressed  object  radius,  r(y ),  is  the  radius  of  the  x-z  cross  section  from  the 
original  ellipsoid  of  revolution. 

•  The  compression  depth,  2d,  is  the  distance  between  the  compression  paddle  and  the 
contact  podium,  and  d  is  the  distance  between  the  aspect  plane  and  the  podium. 

•  The  compressed  object  width,  w(y),  is  the  x  dimensional  width  of  the  x-z  cross 
section. 
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Equations  3.14-3.16  can  implement  the  uniform  compression  model  and  the  uniform  thick¬ 
ness  model  in  the  anterior  and  posterior  region  of  the  breast  respectively  if  the  following 
conventions  are  used: 


w(y)  = 


r(y)  -  { 


wiVellps) 

w(y) 

:  0  <  y  <  yeiip* 

:  uniform  compression  model 

(3.17) 

■  Vellps  <  y  <-■  ycenier 

:  uniform  thickness  model 

r(yeiips)  : 
r(y)  : 

■■  0  <  y  <  yeUps 

:  uniform  compression  model 

(3.18) 

'  yellps  ™  y  ycenier 

:  uniform  thickness  model 

Before  proceeding  further,  it  should  be  noted  that  the  parameters  7 x(y)  and  7 z(y)  are 
approximations  of  ~ix{x>y)  and  7* (a, 2/);  this  is  easily  seen  as  linear  scaling  will  not  return 
the  flattened  elliptical  cross  section  of  the  compressed  breast  to  a  circular  cross  section. 
However,  as  y  and  l(y)  increase,  the  line-of-sight  that  extends  from  an  image  point  on  the 
mammogram  to  the  source  point  approaches  the  normal  z  so  that  variations  in  x  along 
this  line  are  small. 


3.3.2. 1  Determining  the  Uncompressed  Object  Radius,  r(y).  Recall  that  the 
y  axis  is  unaffected  by  compression.  Therefore,  one  can  equate  the  volume  of  a  thin  slice 
from  the  original  breast  ellipsoid  to  the  volume  of  the  comparable  slice  from  the  compressed 
ellipsoid.  The  differential  slice  from  the  original  ellipsoid  is  a  cylinder  of  height  Ay  and 
radius  r(y)  where  yellp8  <y<  ycenier .  The  differential  slice  from  the  flattened  ellipsoid  is 
a  flattened  cylinder  of  height  Ay  and  the  cross  section  given  in  Fig.  3.6.  Since  the  heights 
of  the  slices  are  the  same,  the  areas  of  their  cross  sections  can  be  equated: 


Volu^sHce)  =n.r(yy  =  2d.l(y)  +  n.d.My)  -  %) 


(3.19) 
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w(y) 

Ky) 


Figure  3.6  Cross  section  of  flattened  breast  ellipsoid. 
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Solving  for  r: 


(3.20) 

(3.21) 


Since  l(y)  <  w(y),  ^^(^  -  1)  is  less  than  1.  Using  the  Taylor  expansion,  where 
\/l  +  small  ~  1  +  ,  r(y)  can  be  approximated: 

The  constant  |  •  (|  -  1)  =  0.137.  If  r(y)  is  approximated  using  an  elliptical  cross 
section, 


1  + 


I .  z-4 

2  te(w)  W 


--1) 

7T  / 


(3.22) 


r  approx 


(y)  = 


ld-w(y) 


(3.23) 


then  this  assumption  yields  a  7%  error  if  /(?/)  =  w{y)j 2.  From  the  empirical  object  study, 
Ky)  ~  w(y)/ 2  is  a  likely  condition.  An  error  of  this  size  is  untenable  this  early  in  the 
calculation  of  the  compression  recovery  parameters,  so  we  are  motivated  to  depart  from  a 
pure  elliptical  model  and  develop  estimates  for  yeups  and  l(y). 


S. 3,2.2  Estimation  of  yeup8.  Recall  that  yeUp3  is  the  distance  from  the  pole 
of  the  breast  ellipsoid  to  the  y  location  where  the  skin  collapses  against  the  compression 
paddle.  Revisiting  the  empirical  object  study  discussed  in  Section  3.2,  we  have  considered 
an  objects  cross  section  in  the  x  =  0  plane  denoted  as  X(f),y,  z).  The  cross  section 
depicted  in  Fig.  3.5,  contains  the  axis  of  revolution  and  the  z  axis.  When 
soft-tissue  objects  are  placed  under  vigorous  compression,  the  anterior  tip  of  X(0,y,z)  is 
consistently  circular  as  is  the  medial  and  lateral  tips  of  the  X(x,  y centers  2),  the  object’s 
cross  section  in  the  y  =  ycenter  plane. 

The  forces  that  cause  this  phenomenon  are  the  same  forces  that  conform  a  fluid-filled 
bubble  to  a  sphere  [24].  The  bubble  is  minimizing  its  surface  tension  given  the  pressure 
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exerted  by  its  internal  fluids.  A  soft-tissue  object  would  react  similarly  if  gravity,  friction 
or  structural  forces  are  negligible  compared  to  the  pressures  of  the  object’s  fluid.  Under 
vigorous  compression,  the  skin  of  the  breast  remains  in  contact  with  the  compression  paddle 
until  the  surface  of  least  tension  can  pull  the  skin  away  from  the  compression  paddle  and 
transition  to  a  resting  posture  against  the  podium.  In  the  limit  of  high  compression,  the 
anterior  tip  of  ,y,z)  is  a  complete  half  circle  with  d  as  the  radius  of  the  circle.  Recall 
that  2d  is  the  distance  between  the  compression  paddle  and  contact  podium  and  that  d 
is  the  height  of  the  aspect  plane  above  the  contact  podium  as  depicted  in  Fig.  3.5.  As  in 
Fig.  3.5,  if  the  pole  of  the  breast  ellipsoid  defines  the  location  of  y  =  0,  then 

Uellps  ^  (3.24) 

3. 3. 2. 3  Estimation  of  l(y).  The  x-z  cross  section  of  the  flattened  ellipsoid 
(illustrated  in  Fig.  3.6)  is  estimated  as  a  box  flanked  by  two  half-ellipses.  The  param¬ 
eter  l(y)  is  the  x  dimension  of  the  box.  From  the  observations  of  the  X(0,y,z )  and 
x (x,  y center >z)  cross  sections  in  compressed  objects  (see  Section  3. 3. 2. 2),  the  only  locations 
where  l(y)  is  known  are  0  <  y  <  yeUp3  and  y  =  ycenter  where  respectively  l(y)  =  0  and 
center)  =  w{ycenier)  —  2  yenps.  Using  Eq.  3.24  and  Eq.  3.4,  where  a'  =  w(yenps )  and 
c'  =  d,  we  compare  the  dimension  w(y)  -  l(y)  at  two  locations:  (1)  y  =  yellp3  =  d  and  (2) 

U  Vcenter • 


Vellp8 )  Vellps )  —  W {Vellps )  —  2  C  d 

Vcenter )  center)  —  2  yelipS  —  2d 

Since  the  compression  factor  C  is  always  greater  than  1,  w(yellp8)  -  l{yeUps)  is  always 
greater  than  w(ycenter )  -  l(ycenter).  In  fact,  from  the  empirical  object  study,  the  dimension 
w(y)  ~  Kv)  1S  in  general  near  a  maximum  at  y  —  yeups.  A  minimum  estimate  of  l(y)  is 
determined  by  subtracting  w(yeup3)  from  w(y).  Taking  in  account  all  possible  y  locations, 
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lest(y)  — 


0 


(3.25) 


0  <y  <d 

w(y)  -  w(d)  :  d<y  <  ycenter 

3.3.3  Compression  Recovery  Parameters.  The  calculation  of  the  compression 
recovery  parameters  will  incorporate  the  two  compression  models:  uniform  compression 
and  compression  to  a  uniform  thickness.  By  inserting  Eqs.  3.17,  3.18,  3.24  and  Eq.  3.25 
into  Eq.  3.20,  the  uncompressed  object  radius,  r(y),  takes  the  form: 


0  <  y  <  d 

d  —  V  Vcenter 


(3.26) 


Compression  recovery  parameters  are  obtained  from  the  generalized  expressions, 
Eqs.  3.14-3.17  and  the  above  expression  for  r(y),  Eq.  3.26: 


0  <  y  <  d 

d  f;  V  ^  Vcenter 


0  <  y  <  d 

d  ^  V  5;  Vcenter 


(3.27) 


(3.28) 


7 x(y)  0  0 

S  (y)  =010  (3.29) 

0  0  7 z(y)  _ 

where  the  application  of  S(y)  depends  on  the  y  component  of  the  compressed  object  point. 

Since  the  scaling  function  does  not  transform  the  y  component  of  a  three  dimensional 
point,  the  y  component  of  the  compressed  object  point  and  the  uncompressed  object 
point  are  the  same.  Thus,  the  inverse  of  S(y)  can  be  used  to  model  compression  without 
modification: 
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S"l(v)  = 


1 

7  x(y) 


0 


0 


(3.30) 


0 

0 


1 

0 


0 

i 

7 x(v)  . 


3.4  Summary 

In  this  chapter,  expressions  for  the  compression  recovery  parameters  have  been  de¬ 
veloped  so  that  their  calculation  requires  knowledge  of  d  and  w(y)  as  seen  in  Fig  3.6  and 
as  discussed  below: 

The  compressed  object  width,  w(y ),  can  be  found  from  the  breast  boundary,  or 
“skin”  edge,  on  the  mammogram.  The  breast  boundary  is  a  projection  of  the  breast’s 
cross  section  in  the  aspect  plane.  Since  the  small  source  spot  of  a  mammography 
unit  yields  a  diverging  beam  (see  Fig.  2.2),  the  projected  cross  section  width,  wp(yp), 
is  a  magnified  version  w(y).  (See  the  shadows  cast  in  Figs.  3.2  and  3.3.)  Section  4.3 
will  develop  the  final  expressions  for  the  compression  recovery  parameters  7 z(y)  and 
7 z(y)  in  terms  of  wp . 

The  compression  paddle  height,  2d,  is  a  condition  of  imaging  that  -  under  current 
practices  -  must  be  recorded  by  the  radiologic  technologist.  If  a  fixed  lead  BB  is 
placed  at  a  known  location  on  the  compression  plate  and  projected  onto  the  film,  d 
can  also  be  determined  from  the  mammogram.  The  implementation  of  this  added 
practice  is  discussed  in  Section  4.2. 

Now  that  the  object  variances  have  been  addressed,  we  are  poised  to  implement  the  3D 
localization  algorithms.  All  that  remains  to  be  considered  is  the  imaging  geometry  of  the 
mammography  unit.  These  considerations  and  the  3D  localization  algorithms  are  presented 
in  Chapter  IV. 
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IV.  Mammography  Imaging 


This  chapter  discusses  the  imaging  geometry  of  a  mammography  unit  and  completes 
the  development  of  compression  recovery  parameters.  The  final  section  of  this  chapter 
presents  the  3D  localization  algorithms. 

4-1  Point  Source  Geometry 

The  diverging  x-ray  beam  of  a  mammography  unit  magnifies  the  image  of  an  object 
based  on  the  object’s  height  above  the  image  plane.  As  in  Fig.  2.2,  the  x-ray  beam  of 
a  mammography  unit  is  produced  by  bombarding  a  small  metal  target  with  an  electron 
beam.  The  target  area  is  typically  0.3-0. 4mm  in  diameter  and  tilted  to  direct  the  x-ray 
beam  to  the  image  receptor.  The  effective  spot  size  of  the  source  approximates  a  point 
source  which  produces  a  diverging  beam.  The  magnification  of  an  imaged  object  can  be 
predicted  by  considering  a  line-of-sight  that  runs  from  the  source  through  the  object  and 
onto  the  image  plane.  [25] 

4-1.1  Projection  of  an  Object  Point.  Consider  the  simplified  imaging  system 
given  by  Fig.  4.1  and  4.2.  The  source-image  distance  is  given  by  SID,  and  the  podium- 
image  distance  by  pid.  Selecting  a  cylindrical  coordinate  system  where  a  point  is  given  by 
[radius  Langle,z\ ,  the  z  axis  is  set  normal  to  the  image  plane.  The  image  plane  is  located 
at  z  ~  0;  and,  for  now,  pid  is  assumed  to  be  zero.  The  point  source  Q  located  at  Q  = 
[0,  SJZ?].  An  object  point  O  located  at  an  arbitrary  location  above  the  image  plane  so 
that  O  ~  [r0  La,h\.  The  line-of-sight  is  drawn  from  point  Q  through  point  O  to  image 
plane.  The  intersection  of  the  line-of-sight  and  the  image  plane  given  by  the  projected 
point  P  =  [rproj  Za,  0]  where: 


r0  _  SID  —  h 
Tproj  SID 

or 

n  h  . 

ro  —  rproj  •  (1  SID 


(4.1) 
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Source 


Figure  4.1  Detail  of  Fig.  2.2:  Front  view  of  dedicated  mammography  unit.  The  fixed 
source-image  distance  (SID)  and  podium-image  distance  (pid)  are  labeled. 


Q  m 


Figure  4.2  Projection  of  object  point  O  from  point  source  Q .  Line-of-sight  connects 
points  Q,  O,  P 
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Having  determined  this  simple  relationship  from  similar  triangles,  we  will  now  convert 
to  Cartesian  coordinates.  This  is  the  best  notation  since  object  compression  will  affect  the 
x  and  y  components  of  the  radial  distance  r0  disproportionately.  Points  Q,  O,  and  P  in 
Cartesian  coordinates  are  given  as  column  vectors  of  the  form  [x,  y,z]T  so  that: 


Q 


0 

0 

SID 


O 


Vo 


h 


P 


xproj 

Vproj 

0 


where  from  similar  triangles: 


xo  —  xproj  *  (1  SID  ^ 

n  h 

Vo  —  Vproj  ’  (1  SID 


(4.2) 

(4.3) 


x  —  0 

(4.4) 

1  SID 

Vproj  ~ _ 

-*■  0  t 

(4.5) 

SID 


4.1.2  Projection  of  a  Compressed  Object  Point.  The  object  is  compressed  using 
the  fibrous  tissue  model  discussed  in  Chapter  III.  The  compressed  object  point  is  now  Oc  = 
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[Cx  ■  x0,y0,  -£r}T ■  When  the  object  point  is  illuminated  by  the  source  at  Q  =  [0,  0,  SID]T 
the  projected  point  Pc  is  given  by  [xCp,yCp,  0]r  where: 


Cx  *  xp 

X°p  =  ",  hjcl 
1  SID 
.  _  Vo 


Note  that  due  to  the  denominators  of  Eqs.  4.6  and  4.7,  xCp  and  yCp  have  an  non¬ 
linear  relationship  with  xproj  and  yproj.  The  non-linear  term  depends  on  the  height  of  the 
original  object.  Since  we  generally  do  not  know  the  height  of  the  object  above  the  image 
plane,  this  relationship  is  not  optimal  for  our  purposes.  We  would  prefer  to  adjust  the 
line-of-sight  in  compressed  space  to  a  line-of-sight  that  represents  all  possible  locations  of 
the  uncompressed  object  from  image  plane  to  source  point. 

4-1-3  Recovery  of  Entire  Line-of-Sight  to  Object  Curve.  If  the  uncompressed 
object  point  was  illuminated  by  a  source  located  at  Qeffective  =  [0,0,  Cz  ■  SID]T,  xCp 
and  yCp  are  linearly  proportional  to  the  x  and  y  components  of  Peffective  projected  point 
[xp,  yp,  0]T  where: 


(4.6) 

(4.7) 


xp  — 


x0 

1 - - — 

Cr  -SID 


yP  = 


Vo 


1 - *— 

C.-SID 


_ 

Cx 

(4.8) 

=  Vcp 

(4.9) 

Essentially  what  we  have  done  is  adjust  the  entire  line-of-sight  in  compressed  space  by 
weighting  the  x  and  z  axis  by  and  Cz  respectively.  In  applying  these  weights  denoted 
as  compression  recovery  parameters,  a  new  line-of-sight  is  constructed  in  uncompressed 
space.  The  new  line-of-sight  will  hereafter  be  referred  to  as  the  object  curve.  The  object 
curve  represents  all  possible  locations  of  the  uncompressed  object  given  points  Q,  Pc.  the 
compression  recovery  parameters.  No  knowledge  of  the  original  object  height  is  required 
to  construct  the  object  curve! 
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4-1 -4  Magnification/ Minification.  Using  the  conventions  outlined  for  Eqs.  4.6- 

4.9,  a  point  -  compressed  or  uncompressed  ~  can  be  expressed  in  terms  of  its  projection: 


(4.10) 

(4.11) 

where  M  is  the  magnification  of  the  projection  and  m  is  the  minification  of  the  back- 
projection  defined  as: 


xp 

X  —  Xp  *  777/ 

M 

Vp 

y  =  M=y^rn 


(4.12) 

(4.13) 

The  dimension  ^  is  the  distance  from  the  compressed  object  point  to  the  image 
plane.  To  simplify  the  above  derivations,  we  assumed  the  podium-image  distance,  pid,  was 
zero.  In  actual  fact,  we  include  pid  in  the  term,  so  that,  if  the  uncompressed  object 
height  is  ha,  then 


M  = 


1 


1  - 


m  =  1  — 


fa/c. 

SID 

h/Cz 

SID 


h 

cl 


c. 


+  pid 


h0  +  Cz  •  pid 

cl 


(4.14) 


The  effective  podium-image  distance  for  the  uncompressed  object  is  then  pideffect ive  = 
Cz  ■  pid.  This  effective  distance  is  consistent  with  our  strategy  of  applying  compression 
recovery  parameters  along  the  entire  length  of  the  line-of-sight. 


4-2  Potential  for  Determining  Compression  Depth  from  Mammogram 

The  object’s  compression  depth,  2d,  is  an  important  parameter  required  in  the  cal¬ 
culate  the  compression  recovery  parameters  in  Section  3.3.3.  Due  to  the  magnification  of 
the  diverging  beam,  it  is  possible  to  determine  compression  depth  2d  if  a  lead  BB  is  placed 
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on  top  of  the  compression  paddle  at  a  known  location  and  imaged  onto  the  mammogram. 
If  the  thickness  of  the  compression  paddle  is  given  by  pad  and  the  BB-to-source  point 
distance  is  represented  by  the  vector  [xBB,  yBB,  SID  -  2 d-pid-pad]T,  then,  for  example, 
Vbb  can  be  expressed  in  terms  of  its  corresponding  projection  dimension  on  the  film  yBBp 


Vbb  —  Vbbt  •  (1  - 


2d  +pid  +  pad 
SID 


Solving  for  the  object  compression  depth  2d: 


(4.15) 


2d  =  SID  ■  (1  — ^BB  )  —  pid  —  pad  (4-16) 

Vbb„ 

The  projected  distance  yBBp  can  be  expressed  in  terms  of  yBB  and  a  difference  term 
A  such  that  yBBp  —  yBB  +  A.  The  equation  for  2d  simplifies  to: 

SID-  A 

2d= - —-pid -pad  (4.17) 

dBB  +  A  v  ’ 

The  uncertainty  of  2d  is  strongly  dependent  on  the  resolution  of  image,  the  ratio  of 
SID  '  (VBB+&)'  (or  simPly  fif  when  A  <<  yBB)  and  the  uncertainties  of  pid  and  pad. 

4.3  Compression  Recovery  Parameters  in  Terms  of  the  Projected  Object  Width,  wp(yp ) 

This  section  finalizes  the  equations  for  the  compression  recovery  parameters  incor¬ 
porating  wp(yp),  the  projection  of  the  compressed  object  width,  w(y).  Recall  from  Fig.  3.6 
that  w(y)  is  an  x  dimension  with  a  height  d  above  the  contact  podium  so  that  from 
Eqs.  4.10,  4.11,  and  4.13: 


m  —  1  — 


d  +  pid 


SID 

w(y)  =  to  •  wp(yp)  =  to  •  wj—) 

'771/ 


(4.18) 

(4.19) 
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Enfolding  Eq.  4.19  into  Eqs.  3.26-3.28,  the  final  expressions  for  the  compression 
recovery  parameters  are  realized  in  terms  of  readily  available  measurements: 


r(y)  =  < 


2 


\ 

,  m-wp(£)  2d'm 

Vp(i)-Wp(£;). 

d'  2  + 

7T 

0  <  y  <  d 


d  y  ^  2 Jcenter 


(4.20) 


7 x(y)  =  < 


r(y )  • 


m'Wp(m)/2 


o  <  2/  <  d 


d  —  V  ~  y center 


(4.21) 


7 z{y)  =  < 


lm-wp(£)/z 


r(y )  •  ^ 


:  0  <  y  <  d 

•  ^  ^  2/  —  V center 


where  m  is  given  by  Eq.  4.18. 


(4.22) 


These  parameters  allow  us  to  use  the  breast  boundary  on  a  mammogram  and  the 
compression  depth  to  construct  object  curves  in  uncompressed  space  given  the  location  of 
the  source  point  and  a  point-of-interest  on  the  image.  The  line-of-sight  from  image  point 
to  source  point  is  depicted  in  Fig  4.3  along  side  the  object  curve  that  results  from  the 
application  of  -fx(y)  and  7 z(y).  By  determining  the  cross  point  with  the  corresponding 
object  curve  from  with  the  mammogram’s  complementing  view,  it  is  possible  to  obtain 
realistic  answers  for  the  origin  of  a  mammography-detected  lesion.  Now  we  put  these 
parameters  to  use.  The  next  section  describes  the  implementation  of  the  3D  localization 
parameters. 


4-7 


12000, 


iooooJ 


Figure  4.3  The  object  curve  that  results  from  the  transformation  of  a  line-of-sight  from 
compressed  space  into  uncompressed  space. 

4 ‘4  3D  Localization 

This  section  establishes  the  algorithm  in  which  a  line-of-sight  of  a  mammogram  image 
point  is  transform  to  an  object  curve  that  represents  potential  3D  locations  of  the  object 
in  the  uncompressed  symmetrical  breast.  The  3D  location  of  the  object  is  found  at  the 
cross  point  of  two  object  curves  paired  from  the  MLO  and  CC  views. 

4-4-1  Alignment  and  Reconstruction  of  Symmetric  Breast.  The  goal  of  single¬ 
image  alignment  is  to  transform  the  two  dimensional  image  axes  [i,j]  into  the  three  dimen¬ 
sional  reference  axes  [x,y,z]  assigned  in  Section  3.2.2.  The  single-image  transformation  is 
necessary  in  order  to  calculate  and  apply  the  compression  recovery  parameters  jx(y)  and 
lx(y)  properly.  Additionally,  the  initial  single-image  alignment  simplifies  the  secondary 
alignment  that  transforms  the  MLO  reference  axes  and  the  CC  reference  axes  to  a  com¬ 
mon  reference  axes.  This  secondary  view-to-horizontal  alignment  involves  only  a  single 
rotation  matrix  operation. 

4-4- 1-1  Input  Image  Conventions.  All  angle  and  axis  references  discussed 
herein  apply  to  the  views  of  the  left  breast.  Since  the  right  breast’s  horizontal  axis  is  a 
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View  of  Right  Breast  View  of  Left  Breast 


Flipped  Right  View  Unchanged  Left  View 

Figure  4.4  Input  image  convention:  To  simply  processing  algorithms,  the  left  breast  ori¬ 
entation  was  established  as  the  standard  orientation.  Right  breast  images  are 
flipped  as  shown. 


mirror  image  of  the  left’s,  the  image  of  the  right  breast  is  flipped  to  match  the  orientation 
of  the  image  of  the  left  breast  as  in  Fig.  4.4.  When  processing  is  completed,  a  simple  sign 
change  to  the  horizontal  axis  is  all  that  is  required  to  reorient  the  three  dimensional  space 
of  the  right  breast  properly. 

Conventions  for  the  two  dimensional  image  axes  follow: 

•  The  j  axis  is  perpendicular  to  the  film  edge  against  the  chest  wall.  The  positive  j 
ax:is  runs  from  the  posterior  to  the  anterior  breast  regions. 

•  The  i  axis  is  parallel  to  the  film  edge  against  the  chest  wall  and  runs  positive  from 
the  lateral  to  the  medial  margins  of  the  breast. 

4-4-1.2  Initial  Single-Image  Alignment.  For  a  given  image,  the  locations 
of  the  origin  and  the  reference  axes  are  determined  from  the  physical  references  of  the 
imaged  object:  the  aspect  plane  and  the  back-projections  of  the  nipple  line  and  ymax  (the 
intersection  of  the  nipple  line  with  the  breast  boundary)  as  discussed  in  .  Note  that  the 
source  point  is  aligned  to  its  fixed  location  above  the  film,  so  it  is  likely  that  the  source 
point  will  not  lie  along  the  z  axis  where  x  =  0  and  y  =  0. 

The  aspect  plane  is  established  as  the  2  =  0  plane,  and  the  image  plane  at  the 
2  =  —  {d  +  pid)  plane.  At  a  height  of  2  =  SID  —  ( d+pid ),  the  source  point  Qi  is  positioned 
directly  above  the  film  edge  oriented  to  the  chest  wall  and  midway  between  the  adjacent 
film  edges.  The  location  of  the  origin  [0, 0, 0]T  is  established  at  the  back-projection  of  ymax 
into  the  aspect  plane.  As  depicted  in  Fig.  4.5,  the  source  point  Qi  and  any  given  image 
points  Pi  are  translated  in  relation  to  the  origin. 

If  the  angle  between  the  image  axis  j  and  the  nipple  line  is  not  zero,  a  rotation  matrix 
is  used  to  align  given  image  points  to  y.  Clockwise  rotation  about  the  z  axis  is  achieved 
by  [26]: 


cos  9  sin  9  0 

—  sin  6  cos  6  0 
0  0  1 


(4.23) 
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Figure  4.5  Initial  single-image  alignment  for  CC  view:  Translation  of  a  CC  mammogram 
so  that  axis  of  revolution  is  along  y  axis  and  origin  is  at  ypoie.  SID  =  650mm; 
pid  =  10mm.  The  compression  depth  2d  is  unknown  so  is  assumed  to  be 
45mm,  a  typical  compression  depth. 


Figure  4.6  Initial  single-image  alignment  for  MLO  view:  Transformations  required  to 
place  MLO  image  points  in  reference  to  the  breast’s  axis  of  revolution.  SID  = 
650mm;  pid  =  10mm.  The  compression  depth  is  again  assumed  to  be  45mm. 
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so  that  image  point  Pt  is  transformed  into  point-of-interest  P: 


P  =  Rz  Pi 


where 


P  = 


* p 
Vp 


and  the  source  point  is  transformed  in  the  same  manner: 


(4.24) 


(4.25) 


Q  =  Rz  Qi  (4.26) 

Angle  9  is  the  angular  difference  between  the  j  image  axis  and  the  y  reference  axis.  In  the 
medial  lateral  oblique  view,  9  is  often  negative  with  a  magnitude  of  about  20°-30°,  and  for 
the  craniocaudal  view,  9  is  usually  0  or  a  small  positive  angle.  Figure  4.6  illustrates  the 
orientation  and  rotation  transformations  required  to  place  the  image  in  reference  to  the 
breast’s  axis  of  revolution. 

44.1.3  Compression  Recovery.  Given  a  point-of-interest  P  and  its  associ¬ 
ated  source  point  Q,  the  line-of-sight  L{t)  in  compressed  space  is  calculated  so  that: 


L(t)  =  P  +  vt 


where 


£(*)  = 


xL{t) 
Vl(* ) 


zL(t) 


(4.27) 


(4.28) 


and  v  is  a  unit  vector  specifying  the  direction  of  source  from  the  image  point: 
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Figure  4.7  Line-of-Sight  in  compressed  space. 


I Q-P, 

where 

Vx 

V=  ^ 

Vz 


(4.29) 


(4.30) 


The  result  of  the  line-of-sight  calculation  is  illustrated  in  Fig.  4.7.  Recall  that  the  line- 

of-sight  L(t)  is  affected  by  compression.  Compression  recovery  is  modeled  by  scaling  L(t) 

using  S (y)  from  Eq.  3.29  with  Eqs.  4.21-4.22.  To  express  L(t)  in  terms  of  y,  we  note  that 

t  is  a  weight  to  the  unit  vector  v  so  that  the  y  component  of  L{t)  varies  as  Also,  when 

vv 

t  =  0,  the  yL  =  yp.  Putting  these  two  conditions  together  yields: 


y  =  v+Vp 

uv 

t:=Vy-(y-  2/p) 


(4.31) 

(4.32) 
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Figure  4.8  Orientation  of  MLO  and  CC  views  to  the  object  horizontal.  Angle  (3  is  un¬ 
known  but  assumed  to  be  45°. 

and  the  expression  for  uncompressed  object  curve  Lu(y)  (represented  in  Fig.  4.3)  follows: 


Lu(y)  =  S (y)  L(y )  =  S(y)  •  [P  +  v  •  vy  ■  (y  -  yp )]  (4.33) 


4-4-1-4  View-to-Horizontal  Transformation.  The  object  curve  is  trans¬ 
formed  to  a  common  reference  axes  so  the  axes  of  each  view  are  oriented  properly  to  the 
horizontal  of  the  object  (See  Fig.  4.8).  This  transformation  involves  a  rotation  about  the 
y  axis-  The  rotation  matrix  for  clockwise  rotation  about  the  y  axis  is  given  as  [26]: 


Ry  = 


cos  (3 

0 

—  sin  (3 

0 

1 

0 

sin  (3 

0 

cos  (3 

(4.34) 


For  the  craniocaudal  view,  the  angle  (3  =  0°  and  this  rotation  transformation  is  not  re¬ 
quired.  For  the  medial  lateral  view,  the  angle  is  typically  45°  for  the  MLO  view,  but  can 
range  between  30°-60°  depending  on  the  anatomy  of  the  patient.  Angle  (3  must  be  recorded 
by  the  radiologic  technologist  to  provide  the  best  accuracy  in  processing. 
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Figure  4.9  Discrete  rendition  of  MLO  and  CC  object  lines.  The  nearest  point  from  each 
line  is  used  to  narrow  down  the  appropriate  compression  recovery  matrix  S  (y) 
to  be  used  in  obtaining  a  more  exact  solution  (see  Fig.  4.10). 

4-4-1-5  Uncompressed  Object  Curve.  To  summarize  this  section,  the  un¬ 
compressed  object  curve  LH(y)  as  oriented  to  the  object’s  horizontal  is  given  by 

LH(y)  =  Ry  S(t/)  L(y)  =  Ry  S (y)  ■  [P  +  v  •  vy  •  {y  -  yp)\  (4.35) 

This  curve  represents  potential  3D  locations  of  an  object  in  the  uncompressed  symmetrical 
breast  in  reference  to  the  horizontal  axis. 

44.2  3D  Localization.  Given  corresponding  points  Pcc  and  Pmlo  and  their  respec¬ 
tive  source  points  Qcc  and  Qmio  which  have  under  gone  the  initial  single-image  alignment, 
the  uncompressed  object  curves  are  given  by: 


LcM  -^yoo  See (3/1)  •  [Pcc  +  vcc  •  vCCy  •  ( yi  —  yCCj))] 

L mlo(y 2)  ^ymio  ®mlo(3/2)  ’  [ Pmlo  T  VTOi0  •  Vmi0y  •  (7/2  —  2/m/op)] 
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Figure  4.10  Lesion  localized  in  three  dimensions:  Miss  distance  between  MLO  and  CC 
solutions  is  5 mm. 


From  the  digitized  mammogram,  we  have  a  discrete  number  of  possible  S (t/),  usually 
less  than  1000.  Figure  4.9  details  of  the  discrete  points  along  both  MLO  and  CC  object 
curves.  Iterating  through  the  possible  solutions  to  find  the  minimum  distance  between  the 
curves  is  trivial  with  a  computer.  From  sorting  techniques,  yineaT  and  y2ntar  are  obtained 
from  which  the  compression  recovery  matrix  varies  slowly  as  we  approach  the  cross  point. 
Using  the  lines  given  by, 


—  R-ycc  Scc(2/inear)  •  [Pec  +  vcc  •  uCCv  ■  ( y1  -  yCCp)\ 

(4.38) 

=  R*mio  Smi0(y2nsar)  ‘  \P mlo  +  vmio  •  vmi0y  ■  (y2  —  ymiop )] 

(4.39) 

or 

KM 

=  Pcc  +  Vcc  •  Vccv  ■  (yi  -  yCCp) 

(4.40) 

^774/0(2/2) 

Pmlo  "F  Vm]0  '  Vmi0y  ■  (1/2  Vmlop) 

(4.41) 
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it  is  possible  to  calculate  the  the  nearest  cross  point  and  miss  distance  shown  in  Fig.  4.10 
using  the  following  algorithm  [27],  Given 


L'Jt)  =  P;c  +  Kct  (4.42) 

Lmlo(S )  =  Pmlo  +  V„ioS  (4-43) 


where 


t  —  vCCy  (yi  yCCp)  (4.44) 

S  —  Vrinloy  (2/2  —  Vmlop)  (4.45) 


Assume  lines  intersect,  and  find  t0  where  L*mlo(t0)  =  L*cc(t0 )  so  that: 


P'cc  +  Kcto  -  Pmlo  +  V*mlot0 


(4.46) 


Subtract  point  P*c  from  both  sides  of  Eq.  4.46,  and  cross  multiply  by  vector  vj^ 


iKc  X  v;,olb  =  [P'mlo  -  P'cc\  X  V^lo  (4.47) 

To  solve  for  t0 ,  one  must  solve  the  nested  cross  products  which  involves  taking  the  deter¬ 
minate  of  the  vectors  (P^lo  -  Pc*c),  v^lo,  v^c  x  v^lo: 


to 


Det[(Pr 


mlo 


P*c)  >  v 


mlo  5  vcc 


X  V 


mloJ 


l^c  X  V^lo| 


Similarly, 


„  _  Det[(Pmlo  ~Pcc),Kc^, 

i  - - - 


cc  X  V^loj 


|V‘C  X  V^J2 


(4.48) 


(4.49) 
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If  L*c(t)  and  L^lo(s)  intersect,  the  cross  point  O  is  at  L*cc(t0 )  =  L*mlo(s0).  If  the  lines 
are  skewed,  the  mean  cross  point  Omean  and  the  miss  distance  AO  are  given  by: 


(n  _  ^cci^o)  Lmlo{So)  /A  r~\ 

mean  2  (4.5UJ 

A O  =  L*Jt0)  -  L*ml0(s0)  (4.51) 

The  point  Omean  estimates  the  common  object  point  in  the  uncompressed  breast 
from  which  the  points-of-interest  Pcc  and  Pmi0  were  projected. 

4-4-3  Cross  Projection.  If  corresponding  points-of-interest  are  unknown,  a  cross 
projection  algorithm  can  be  used  to  project  a  line-of-sight  from  one  image  onto  the  image 
plane  of  the  other.  The  cross  projected  line  of  sight  then  may  act  as  an  indexing  aid  by 
narrowing  down  the  location  of  a  potential  lesion.  The  following  paragraphs  work  through 
the  projection  of  a  line  of  sight  derived  from  Pcc,  a  point  of  interest  from  the  craniocaudal 
view. 

First,  the  uncompressed  object  curve  of  Eq.  4.35  is  obtained  and  rotated  into  the 
reference  axes  of  the  opposing  image: 


Lcciv)  =  Ryi„  L*(y)  =  Ry  *lo  Rycc  S ce(y)  ■  \PCC  +  v, 


(y  -  2/ccJ]  (4.52) 


where 


L*c{y)  = 


xLx{y) 
VLx(y) 
ZLx{y ) 


(4.53) 

(4.54) 


Next,  to  model  the  compression  undergone  by  the  imaged  object  in  this  aspect,  the 
inverse  of  the  compression  recovery  matrix  S cc(yLX)  is  applied  to  Eq.  4.52. 
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Lgx(y)  =  S cc{Vlx)  L*(y) 


(4.55) 


As  the  final  step,  the  curve  is  the  projected  onto  the  image  plane  and  transformed 
out  of  the  MLO  object  reference  axes  into  the  original  MLO  image  reference  axes. 

4-5  Summary 

In  this  chapter,  we  have  expressed  the  compression  recovery  parameters  in  measurable 
parameters  and  fit  them  into  a  3D  localization  strategy.  We  are  now  ready  to  implement 
the  3D  localization  algorithms.  The  implementation  is  discussed  in  Chapter  V. 
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V.  Implementaion 


This  chapter  charts  the  3D  localization  algorithm  implementation  describing  how  it 
fits  into  the  architecture  of  a  Computer  Aided  breast  cancer  Diagnosis  system.  The  final 
section  is  a  brief  discussion  of  the  modelling  analysis  of  the  algorithms. 

5.1  Algorithm  Implementation 

5.1.1  Front  End  Processing.  The  natural  place  for  the  bulk  of  the  3D  localization 
algorithms  is  in  the  Front  End  Processor  of  a  CADx  system.  The  primary  responsibili¬ 
ties  of  the  initial  algorithm  include  collecting  the  breast  features  needed  to  perform  initial 
single-image  alignment  discussed  in  Sections  4.4.1. 2-4.4.1.4.  Also,  the  algorithm  can  check 
the  alignment  using  markers  such  as  the  BB  in  Fig.  2.6.  The  bread  and  butter  of  these 
algorithms  is  the  ability  to  orient  the  source  point  to  the  film  which  thus  demands  preser¬ 
vation  of  film  edge  locations.  The  location  of  only  three  edges  is  required  —  the  edge  at 
the  chest  wall  and  its  two  adjacent  edges  -  but  if  preserved  in  the  images,  the  resulting 
data  files  would  be  cumbersome,  and  unnecessarily  large  for  most  CADx  processing.  Initial 
algorithms  can  subsample  the  image  to  navigate  large  images  more  readily.  These  front 
end  algorithms  determine  the  breast  area  and  remove  edges  and  view  markers.  Before 
cutting  the  image  files  down  to  a  manageable,  standardized  size,  the  entire  breast  edge, 
the  aspect  parameters  (/3  and  Umax)  and  the  locations  of  any  nipple  or  lesion  markers  must 
be  preserved  to  optimize  3D  localization  efforts.  (For  CADx  systems  that  compare  con¬ 
tralateral  views,  the  outline  of  the  pectoral  muscle  wall  from  contralateral  MLO  views  will 
also  provide  a  key  reference  [15].)  A  summary  of  the  Front  End  Processor  follows: 

•  Given  imaging  parameters: 

1.  Fixed  source-to-film  location  including  the  source-image  distance  SID 

2.  Fixed  podium-to-film  distance,  pid 

3.  Variable  rotation  of  the  x-ray  tube,  angle  (3 

4.  Variable  compression  depth,  2d 

•  Locate  =>  Evaluate: 
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L  Film  edges  =>  Source  to  image  location 

2.  Breast  boundary  =>  Projected  compressed  object  width,  wp(yp)  =>  Com¬ 
pressed  object  width,  w(y) 

3.  Angle  6  between  the  nipple  line  and  the  j  image  axis  =>•  y  axis 

4.  Intersection  of  the  nipple  line  and  breast  boundary,  ymax  =>  Origin  reference 
point,  ypoie 

Results  of  the  Front  End  Processor  are  passed  to  an  Indexing  module  which  will  perform 
the  actual  3D  localizations  on  ROIs  which  the  indexer  receives  from  a  Focus  of  Attention 
module. 

5.1.2  Indexing.  The  Indexing  module  of  a  CADx  system  uses  limiting  hypothe¬ 
ses  to  sort  out  potential  malignancies  from  list  of  regions  of  interest  (ROIs)  supplied  by 
the  system’s  sementor,  the  Focus  of  Attention  module.  The  hypothesis  checked  by  the  3D 
localizer  is  as  follows:  Asymmetries  and  abnormalities  that  can  be  verified  by  the  com¬ 
plementing  views  of  the  breast  and  localized  to  a  small  3D  space  are  likely  candidates  for 
malignant  regions. 

The  3D  localization  algorithms  convert  the  compressed  space  containing  lines  of 
sight  from  image  ROIs  to  uncompressed  space  represented  by  object  curves.  The  nearest 
cross  points  with  object  curves  from  the  complementing  image  are  evaluated  to  determine 
confidence  in  localization.  Confidence  factors  will  depend  on  miss  distances  of  the  object 
curves  and  the  relative  location  of  the  3D  object  point  to  the  aspect  plane  and  back- 
projected  breast  boundaries.  ROI  pairs  that  survive  the  3D  localization  are  passed  to  the 
classification  module  which  categorizes  lesions  based  on  ROI  features.  The  3D  location  of 
potentially  malignant  regions  are  passed  to  the  human  machine  interface  for  clinical  use. 

Additionally,  object  curve  can  be  transformed  in  the  compressed  space  of  the  com¬ 
plementing  image  and  projected  onto  the  image  plane  of  this  image  providing  expected 
locations  of  a  lesion.  Looser  segmentation  criteria  in  this  area  of  the  image  may  uncover 
the  corresponding  ROI  without  detrimentally  affecting  the  false  detection  rate. 

•  Given  =>  Evaluate: 
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1.  ROI  definition  point  ==>  Line-of-sight  in  compressed  space 

2.  Line-of-sight  in  compressed  space  =>•  Object  curve  in  uncompressed  space 

3.  Object  curves  paired  from  complementing  views  =>  Nearest  cross  point  and 
miss  distance 

•  Additionally,  Given  Evaluate: 

4.  Object  curve  in  uncompressed  space  =>  Same  object  curve  transformed  into 
the  compressed  space  of  the  complementing  view  =>  Cross  projection  onto  the 
complementing  image 

5.  Object  curve  or  high  confidence  cross  point  =>  Comparable  location  in  uncom¬ 
pressed  space  of  the  contralateral  breast  =>  Projections  onto  the  contralateral 
views 

Results  of  the  Indexing  module  are  passed  to  the  Classification  module  which  cate¬ 
gorizes  ROI  pairs  and  the  Human  Machine  Interface  module  which  provides  3D  locations 
of  potential  malignancies  for  clinical  use.  Additionally,  expected  lesion  locations  in  a  com¬ 
plementing  view  are  passed  to  the  Focus  of  Attention  module. 

5.2  Implementation  Modelling 

A  mathematical  model  was  created  to  evaluate  the  effectiveness  of  the  algorithms 
and  how  uncertainties  in  measurement  will  affect  alignment  and  results. 

The  model  set  up  a  simulated  image:  A  3D  point  was  placed  in  a  volume  defined  by  a 
paraboloidal  boundary.  Uniform  compression  was  applied  to  the  volume  and  point.  Using 
a  real  case  source  to  film  orientation,  the  compressed  point  and  aspect-plane  boundary  of 
the  compressed  volume  were  projected  onto  an  image  plane. 

From  this  simulated  image,  the  algorithms  for  compression  recovery  and  3D  localiza¬ 
tion  were  applied  in  an  attempt  to  locate  the  original  3D  point  with  degraded  alignment 
parameters. 

In  modelled  cases,  errors  in  alignment  parameters  had  the  most  significant  effect  on 
the  y  component  of  estimated  object  point.  This  is  consistent  with  real  data  where  miss 
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Figure  5.2  Modelled  error  dependency  to  angle  6 ,  the  angle  between  the  nipple  line  and 
the  image’s  j  axis. 

distances  between  the  nearest  points  from  a  MLO  object  curve  and  a  CC  object  curve  are 
generally  greatest  in  the  y  direction.  (See  Fig.  4.10.) 

Several  runs  were  made  using  points  far  from  the  origin  but  within  the  volume  of  a 
typical  breast.  Result  of  a  typical  run  is  presented  in  Fig.  5.2.  From  these  runs,  the  two 
most  critical  parameters  of  the  alignment  are  the  compression  depth  d  and  the  angle  6 
between  the  nipple  line  and  the  image’s  j  axis. 

By  degrading  all  of  alignment  parameters  at  once,  the  overall  sensitivity  of  the  algo¬ 
rithms  was  gauged.  In  these  runs,  the  miss  distance  from  the  true  point  could  typically  be 
held  below  10  mm  by  keeping  fixed  parameter  uncertainties  to  less  than  1%  and  the  mea¬ 
surable  compression  distance  2d  to  less  than  10%  of  their  true  values.  The  rotation  angles 
were  kept  within  ±5°.  These  numbers  are  relevant  for  a  significant  portion  of  the  breast. 
However,  tumors  near  the  chest  wall  will  be  difficult  to  locate  accurately  as  estimates  of 
compression  recovery  parameters  may  prove  insufficent. 
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VL  Conclusions 


This  thesis  represents  the  first  attempt  to  develop  the  components  of  a  CADx  system 
that  would  verify  the  detection  of  potentially  malignant  lesions  through  three  dimensional 
localization.  The  3D  localization  algorithms  herein  assume  the  use  of  a  dedicated  mammog¬ 
raphy  unit  that  is  equipped  with  a  90°  compression  paddle  and  that  has  fixed  source-to-film 
orientation  and  podium-to-image  distance. 

The  algorithms  are  developed  specifically  for  standard  mammography  screenings 
where  craniocaudal  (CC)  and  medial  lateral  oblique  (MLO)  radiographic  views  are  per¬ 
formed.  Standard,  properly  performed  patient  positioning  is  necessary  for  quality  images 
with  landmarks  that  reflect  the  alignment  and  dimensions  of  the  compressed  breast. 

Application  of  these  algorithms  requires  the  input  of  two  additional  imaging  param¬ 
eters:  the  rotation  of  the  x-ray  tube  and  the  compression  distance  -  distance  between 
the  compression  plate  and  contact  podium  at  the  time  of  imaging.  With  these  additional 
parameters,  confidence  in  constructing  object  curves  improves  greatly. 

This  feasibility  investigation  located  microcalcifications  within  10-15  mm  and  elim¬ 
inates  quadrant  ambiguities.  Accuracy  measures  are  based  on  knowing  the  fixed  param¬ 
eters,  source-image  distance  and  podium-image  distance,  of  the  mammography  imaging 
system  with  accuracies  of  ±5  mm  and  ±2  mm  respectively.  The  adjustable  parameters, 
x-ray  tube  rotation  angle  and  the  distance  from  compression  paddle  to  contact  podium 
distance,  are  assumed  to  be  known  with  accuracies  of  i5°  and  ilO  mm  respectively.  Accu¬ 
racies  of  the  adjustable  parameters  can  be  much  better  than  this,  and  firm  measurements 
will  lead  to  much  improved  results. 
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